METHOD AND DEVICE FOR IMPROVING DFE PERFORMANCE IN A TRELLIS -CODED 

SYSTEM 

BACKGROUND OF THE INVENTION 

1. Field of the Invention 

The present invention is directed in general to digital 
signal processing, and in particular to receiver based methods and 
devices for improving decision feedback equalizer ("DFE") 
performance in a trellis coded system. 

2. Background of the Invention 

In many digital communication scenarios (e.g. telephone 
transmission, broadcast TV transmission, cable etc.) The 
transmitted signal arrives at the receiver through more than one 
path in addition to the direct path. This condition is called 
"multipath" and leads to intersymbol interference ("ISI") in the 
digital symbol stream. This ISI is compensated for in the receiver 
through an equalizer which in many cases is a DFE as shown in Fig. 
1. U.S. Patent No. 5, 572 ,262 shows one method of combating these 
multipaths . 

A DFE 10 (Fig. 1) has two filter sections, a forward 
filter 12 and a feedback filter 16. The input to the forward 
filter 12 is the received data which includes the transmitted 
symbol sequence a k , noise n k and multipath h ± . The input to the 
feedback filter 16 is the quantized equalizer output a k . The 
output of both the sections are summed 18 to form the final 
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equalizer output a k which is also the input to the next stage in a 
trellis-coded system, the trellis decoder. While a DFE performs 
better than a linear equalizer in severe ISI, the performance is 
limited by error propagation through the feedback filter 16 of the 
DFE 10. Error propagation occurs in the feedback filter 16 when 
the quantized equalizer output a k is not. the same as the transmitted 
symbol a k . If an error is made in determining the symbol a k at the 
output of the slicer 11, this incorrect symbol is fed back to the 
input of the feedback filter 16 and propagates. In many systems 
which employ error correction codes like trellis codes and/or Reed- 
Solomon codes to obtain very low error rates at moderate SNRs, the 
"raw'' symbol error rate (SER) at the equalizer output can be 
extremely high. For example, in the VSB system, at threshold in 
white noise the SER at the equalizer output is about 0.2. The 
increased error propagation due to these high SERs can cause the 
DFE to lose a couple of dB in performance as compared to the case 
of no error propagation. Additionally, the error propagation 
causes the error sequence at the equalizer output to be correlated, 
since it depends on past incorrect symbol decisions. This 
correlation has an adverse effect on the subsequent trellis decoder 
which is usually designed for a white noise sequence. 



SUMMARY OF THE INVENTION 

Accordingly, it is an object of the invention to reduce 
the mean-squared-error (MSE) and correlation of the DFE output 
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error sequence. This object is achieved by placing a short 
adaptive predictor filter after the DFE in order to whiten the 
error sequence. The ISI introduced into the data symbol stream by 
this filter is then compensated in the trellis decoder by the use 
of delayed decision feedback sequence estimation (DDFSE) as 
described in "Delayed decision-feedback sequence estimation," by A. 
Duel-Hallen and C. Heegard, IEEE Trans. Commun., vol. COM-37, no. 
5, pp. 428-436, May 1989. 

The invention has applications in any trellis coded system 
that utilizes a DFE for equalization, especially in cases where the 
SER after the equalizer is high and error propagation causes 
problems. An example is terrestrial transmission of digital TV 
signals . 

The invention can also be used in trellis coded systems 
with DFEs which are subject to colored noise interference. Again, 
the DFE cancels much of the interference but the adaptive predictor 
serves to whiten the noise further. This helps improve the trellis 
decoder performance. 

The invention accordingly comprises the several steps and 
the relation of one or more of such steps with respect to each of 
the others, and the apparatus embodying features of construction, 
combinations of elements and arrangement of parts which are adapted 
to effect such steps, all as exemplified in the following detailed 
disclosure, and the scope of the invention will be indicated in the 
claims . 
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BRIEF DESCRIPTION OF THE DRAWINGS 

For a more complete understanding of the invention 
reference will be had to the following drawings: 
Figure 1 shows a standard DFE ; 

Figure 2 shows a DFE in accordance with the invention; and 
Figure 3 shows a DFE in accordance with the invention 
during a training sequence. 

DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENTS 

Figure 1 is a diagram of the standard decision feedback 
equalizer 10 (DFE). The DFE includes a forward filter 12, a slicer 
14, a feedback filter 16 and a subtractor 18. Let a k be the 
transmitted trellis-coded symbol stream. The received signal r k 

Vk = ^ hi ak+d h -i rik 

i=0 

after multi-path distortion and added noise n k can be written as 
where hi, i = 0... L h -1 is the multipath channel of length l h and 
delay d h , and n k is the additive noise which in general is neither 
gaussian nor white. The forward filter 12 is used to remove the 
pre echo or ghosts in the received signal. The slicer 14 quantizes 
the signal a to the nearest symbol a k . If an error is made in this 
quantization the error is passed to the feedback filter 16 and 
remains in the system. The output of the feedback filter 16 is 
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subtracted from the output of the forward filter 12 to provide a k . 
a k is an estimate of the transmitted symbol a k plus, an error e k . 

u 

i=0 i=l 

It can also be expressed as: 

where f i7 i=0... L f -1 are the forward equalizer taps, bi, i=l... L b 
are the feedback taps, d f is the delay through the forward 
equalizer, d b is the delay in the feedback equalizer and a k is the 
constellation point closet to a k . In the absence of error 
propagation, i.e. if a k = a k , the error sequence e k at the equalizer 
output 20 is white. However, in most cases the error propagation 
causes this error sequence to be correlated, that is, the noise 
samples are no longer independent. The "colored" noise affects the 
performance of a trellis coder, because a trellis coder is 
optimized for performance in a channel having all white guassian 
noise . 

In accordance with the invention, as shown in Fig. 2, an 
adaptive filter 22 is placed at the output of the DFE 10 but before 
a trellis decoder (not shown) . The output of filter 22 can be 

if 

expressed as 

where (1, g 1# g 2 , g 3 ...gLg) are the taps of the adaptive filter. 
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Since a k = a k + e k/ then the adaptive filter output can be written 



It 

= dk + Ysgidk+i + e'it 
/=/ 

as 

If the filter taps are chosen so as to minimize the variance of 
e' k , the SNR of the sequence y k can be improved. In addition, since 
e' k is the prediction error sequence of the equalizer output error 
sequence e k , it will be white see Widrow and Stearns, "Adaptive 
Signal Processing," (hereby incorporated by reference), at pages 
99-116) , which does not affect the performance of a trellis 
decoder. 

Training of the Adaptive Filter 

To minimize the error from the output of the DFE, or in 
other words to tune the adaptive filter taps g to the error e k , the 
adaptive filter 22 is first placed through a training sequence as 
shown in Fig. 3. In many applications, such as digital TV, the 
training sequence is part of the transmitted signal. After the 
equalizer 10 has converged (via blind means, without using the 
signal a k , or trained means which uses the signal a k ) the adaptive 
filter 22 receives a training sequence which is the difference 
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between the output of the DFE a k and the transmitted symbol 
sequence a k . This difference is the error e k produced by the DFE . 

a - a k = e k (5) 

This error sequence e k is then input into the adaptive filter 22. 
The adaptive filter 22 forms an output sequence x k as shown in Fig. 

3 , where 

g(k + l) = g(k)- MXk e(k) 
The filter taps g k are adapted using the LMS algorithm as follows 
where g = and e(k) = e k _i, e k _ 2 , ... e k . Lg ] . This adaptation adapts 
the filter taps to minimize the mean squared, error e k 2 , of the DFE. 

Since the trellis decoder uses the taps [gi, g 2/ ... g Lg ] 
in a feedback loop, error propagation can also occur hence it is 
also beneficial to limit the size of the taps g during adaptation, 
so that the trellis decoder that uses these taps does not suffer 
error propagation. If g is too small, however, the efficiency of 
the adaptive filter is reduced. Accordingly, an additional power 
constraint is imposed on the LMS algorithm to limit the amplitude 
of the taps which reduces the error propagation in the DDFSE 
trellis decoder (described next) . A parameter P is chosen such 
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that it is required that 

At each step of the LMS algorithm this condition is tested, and if 
violated, the taps are rescaled appropriately. 

The Adaptive Filter and DDFSE 

Once the adaptive filter 22 is appropriately trained to 
minimize e k/ a k = a k + e k is input to the adaptive filter 22. The 
adaptive filter 22 although it has been trained to minimize e k/ it 
will also distort a k . Equation 9 shows this distortion and 



yk= a k+Y.8i a *-i 

i=i 

represents the output of adaptive filter 22 as follows: 
As stated above, if the filter taps g are chosen to minimize e k , 
the SNR of the sequence y k can be improved. y k , however, is a 
distorted a k and includes the ISI introduced into the data stream 
by the adaptive filter 22. This distortion is then compensated for 
in the trellis decoder by use of delayed decision feedback sequence 
estimation (DDFSE) as described in A. Duel-Hallen and C. Heegard, 
"Delayed decision- feedback Sequence Estimation, " IEEE Trans. 
Common., Vol. Com - 37, no. 5, pp. 428-436, May 1989, hereby 
incorporated by reference, and as summarized below. 
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From the definition of y k , we see that an optimum trellis 
decoder which will remove the distortion of a k , should minimize the 



yrcLk-^giCtk-i 



i=l 



metric (maximum likelihood decoding) : 

This equation, however, requires past symbol sequences a k _i to be 
saved, and each tap g ± in the adaptive filter therefore introduces 
more memory into the system which causes the number of steps of a 
trellis decoder to grow exponentially with the number of taps in 
the adaptive filter 22. Therefore an expanded trellis is necessary 
to accommodate the memory (a k _i) introduced by the adaptive filter 
22 . 

A suboptimum, but computationally less intensive way of 
performing the trellis decoding is to instead minimize the 

zL yk-ak'YjgiEk-i.j 
following metric: 

where the sequence a k _i,j, i = l, ... L g is the survivor symbol 
sequence associated with state j in the trellis. This scheme does 
not expand the number of states in the original trellis, but 
instead introduces decision- feedback in each of the trellis states. 

That is, since this scheme uses a k _i, which is merely an estimate 
of, rather than the actual value a k .i, there is no memory introduced 
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into the system. Since there is no memory, an expanded trellis is 
not required, i.e. the number of states in the trellis remains the 
same even with the additional adaptive filter 22. 

There is the possibility of error propagation in this 
implementation and hence the precaution is taken in the LMS 
algorithm of limiting the amplitude of the filter taps. The 
optimum value of P will depend on the trellis code and application. 

In the United States HDTV example, simulation results indicate 
that a value of P=0.15 gives good performance. 

It will thus be seen that the objects set forth above, 
among those made apparent from the preceding description, are 
efficiently attained and, since certain changes may be made in 
carrying out the above method and in the construction set forth 
without departing from the spirit and scope of the invention, it is 
intended that all matter contained in the above description and 
shown in the accompanying drawings shall be interpreted as 
illustrative and not in a limiting sense. 

What is claimed is: 

1. A decision feedback equalizer, (DFE) comprising: 

an input which receives an input signal comprising, a 
transmitted symbol stream, noise and multipath; 

a DFE output which provides a DFE output signal; 

a forward filter which filters the input signal; 

a decision feedback loop comprising a subtractor, a 
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